- Deep hands-on expertise in Databricks (Scala or Python).
- Experience in Design and implementation of Big Data technologies (Apache Spark, Hadoop ecosystem, Apache Kafka, NoSQL databases) and familiarity with data architecture patterns (Data lakehouse, delta lake, streaming, Lambda/Kappa architecture).
- Experience in working as a Big Data Engineer: query tuning, performance tuning, troubleshooting, and debugging Spark and other big data solutions.
- Familiarity with a full range of data engineering approaches, covering theoretical best practices and the technical applications of these methods.
- Experience building and deploying a range of data engineering pipelines into production, including using automation best practices for CI/CD.
- Very good experience in writing SQL queries.
- Hands-on experience with any of the cloud providers such as AWS or Azure.
- Familiarity with databases and analytics technologies in the industry including Data Warehousing/ETL, Relational Databases, or MPP
- Certified Databricks Associate Developer (Scala or Python) is highly preferable.
- Ability to juggle and prioritize multiple tasks within a collaborative team environment
- Desire to learn and grow both technical and functional skill sets, and drive team’s potential
- Proven ability leveraging analytical and problem-solving skills in a fast paced environment
- Certified Databricks Associate Developer (Scala or Python) is highly preferable.
- Trained in Data Factory, Delta lake, Data bricks Notebooks
- Working experience in an international team environment
Company
Location
Bangalore - India
Job type
Full-Time
Python Job Details
Aufgaben
Senior Big Data Engineer
Keywords: Microsoft Azure, Azure Data Factory, ADLS, Log Analytics, ELT, ETL, Big Data,
Role
Senior Big Data Engineer - Data Engineering and Data visualization.
Job Qualifications
Technical Skills & Competencies:
Preferred Experience and Skills
Microsoft Azure and AWS Certifications
Keywords: Microsoft Azure, Azure Data Factory, ADLS, Log Analytics, ELT, ETL, Big Data,
Role
Senior Big Data Engineer - Data Engineering and Data visualization.
Job Qualifications
Technical Skills & Competencies:
Preferred Experience and Skills
Microsoft Azure and AWS Certifications
Qualifikationen
More Developer Job Boards
Fullstack Developer Jobs Golang Jobs JavaScript Jobs Python Jobs React Jobs Rust Jobs Java Jobs